Papers by Du Hui Lee
SignBLEU: Automatic Evaluation of Multi-channel Sign Language Translation (2024.lrec-main)
Copied to clipboard
| Challenge: | Sign languages communicate information through the hands, but also facial expressions and upper body movements. |
| Approach: | They propose a task to generate a single sequence of glosses for sign language translation and a new metric to capture multiple signal channels. |
| Outcome: | The proposed metric captures multiple signal channels and correlates with human judgment on a system-level task. |
Sign Language Production With Avatar Layering: A Critical Use Case over Rare Words (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing vision-based sign language production approaches suffer from out-of-vocabulary (OOV) and test-time generalization problems. |
| Approach: | They propose an avatar-based sign language production system that generates sign language videos from spoken language expressions. |
| Outcome: | The proposed system achieves higher BLEU-4 and higher ROUGE-L scores on a new Korean-Korean sign language dataset. |